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Unlike charge and spin, the orbital degree of freedom of electrons in transition metal oxides is 
difficult to detect. We present the theoretical study of a new detection method in metallic orbitally 
active systems by analyzing the quasiparticle scattering interference (QPI) pattern of the spectro- 
scopic imaging scanning tunneling spectroscopy, which is sensitive to orbital structures and orbital 
ordering. The QPIs for the d^z and dyz-orbital bands in the t29-orbital systems show a charac- 
teristic stripe-like feature as a consequence of their quasi-one-dimensional nature, which is robust 
against orbital hybridization. With the occurrence of orbital ordering proposed in Sr3Ru207 and 
iron-pnictides, the stripe-like QPI patterns exhibit nematic distortion breaking the C4-symmetry. 
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PACS numbers: 68.37.Ef, 61.30.Eb 



Orbital, a degree of freedom independent of charge 
and spin, plays an important role in various phenomena 
of transition metal oxides (d-orbital) and heavy-fermion 
compounds (/-orbital), including metal-insulator transi- 
tions, unconventional superconductivity, colossal magne- 
toresistance P, 0, [1, Orbital ordering and excita- 
tions have been observed in many Mott-insulating tran- 
sition metal oxides such as Lai_a:Sra:Mn03, La4Ru20io, 
LaTiOs, YTiOa, KCuFg, etc. In addition, cold 

atom optical lattices have opened up a new opportunity 
to study orbital physics with both bosons and fermions, 
which has recently attracted considerable experimental 
and theoretical research attentions [ol [lol 



13, 14 



Many metallic transition metal oxides, such as stron- 
tium ruthenates and iron pnictides, are orbitally active. 
Their Fermi surfaces are composed of different compo- 



nents of the i2g-orbitals. 



and dyz- Differ- 



ent from the dj-^-band which is quasi-two-dimensional 
(2D), the dxz and d^z-bands are quasi-one-dimcnsional 
with strong in-plane anisotropy. Their Fermi surfaces 
arc strongly nested, resulting in strong incommensurate 
spin fluctuations in strontium ruthenates and iron pnic- 
tides [m, [13, • Furthermore, the quasi-lD bands also 
play an important role in the electronic nematic ordering 
observed in the bilayer Sr3Ru207 [11, 0, 21 1 between 
two consecutive metamagnetic transitions in the exter- 
nal magnetic field, which contributes another intriguing 
example of spin-orbital interplay ^, 23, 24, 25, 26]. The 
nematic ordering has been interpreted as orbital ordering 



in strongly correlated systems [H, M, [m, [H, m , and has 
been just applied into the metallic t2g-orbital systems of 
Sr3Ru207 [34]. We find that this technique provides a 
sensitive method to detect orbital degree of freedom and 
orbital ordering by studying the quasi-particlc interfer- 
ence (QPI) in the quasi-lD d^z and dyz bands. In con- 
trast to the well-established QPI scenario for the single 
band system before, the T-matrix acquires momentum 
dependent form factors which forbid some QPI wavevec- 
tors and result in stripe features in the Fourier trans- 
formed STM images. The orbital ordering exhibits in the 
nematic distortion of the stripe QPI patterns. The ap- 
plications of our analysis to the nematic orbital ordering 
in strontium ruthenates and the iron pnictide supercon- 
ductors will be demonstrated. 

We consider the band Hamiltonian with the d^z and 
Ho = yit„Hr.^, and 



dyz-orbital bands as 



Hr = 
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4<' cos kx cos ky 
and dyz orbitals 



between d^z and dyz-orbitals by us [27[ and also indepen- pseudo-spinor as 



dently by Raghu et al. [2£^ 

In contrast to charge and spin whose detection meth- 
ods have been maturely developed, the orbital degree of 
freedom is very difficult to measure especially in metallic 
orbital systems. In this letter, we present the theoreti- 
cal study of a new method to detect the orbital degree 
of freedom by employing the technique of spectroscopic 
imaging scanning tunneling microscopy (SI-STM). This 
technique is an important tool to study competing orders 
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/^^ is the hybridization between d^z 
which is different from materials to 
materials and can be complex function in general. 
t|| and t±_ are the nearest neighbor longitudinal and 
transverse hopping integrals for the dxz and dj,z-orbitals, 
and i|| >> tj^. t' is the next-nearest neighbor intra- 
orbital hopping integral. We define the basis of the 

(d r ,d t ■ Ht can be 

V xzka^ yzka^ ka 

diagonalized by introducing the unitary transformation 



Uj:^ such that ul Ht^Ut^ 
in the basis of (br 
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where tan2^r 

ka 
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k.a ' 



The 



eigenvalues and the corresponding eigenvectors are: 
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Et - + ± - + 4|/fc.P)/2 and 

V-fc. = (7+,fe,, 7„,fcJ^ = ^^L'^fc,.^ respectively. 

Next we introduce the scattering Hamiltonian for 
the non-magnetic single impurity at f^. Assuming 
the isotropy of the impurity, Himp does not mix dxz 
and dyz orbitals as Himp = Vb Y^ia (^L,icr'^a:z,io- + 
^Iz i<7'^yz,ia-)^i-ri j where we set the impurity location 
fi = (0, 0) at the origin. In the basis of the band eigen- 
fimction ipj:^, Himp is expressed as 



Himp — 



/-^ ^fe(T,a k,k':ab^k'a. 
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where ~ 

k,k': 



ka k', 



is the effective scat- 



ab 



tering matrix, and a, 6 = ± are eigen-band indices. 
This momentum-dependence generated by the orbital hy- 
bridization has non-trivial consequences in the QPI spec- 
tra shown later. 

The Green functions with the impurity satisfy 
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FIG. 1: (a) The Fermi surfaces with an ideal quasi-lD bands 
without hybridization and (b) the corresponding FT-STM im- 
age. The stripe features in (b) at = and qy = result 
from the quasiparticle scatterings indicated by arrows within 
the same lines in (a), and those appearing at qx = ±2fcF and 
qy — ±2kF come from scatterings indicated by arrows be- 
tween different lines in (a), echoing the Friedel oscillation in 
exact ID case. 



G„{k, k') = Go.Ak)Sf:,k' + Go,.(fc)rf g,Go,a(fc') (4) 



where G, Go and the T-matrix are 2 x 2-matrices in terms 
of band indices. The T-matrix and the bare Green's func- 
tions Go,o-(fc) defined as: 
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and [G^,^(fc)]a6 = + z<5 - ElJ5a,b. 



In previous theoretical analysis of QPI [31|, the sin- 
gle impurity T-matrix was simplified as momentum- 
independent for the single band systems. This simpli- 
fication is no longer valid in hybridized quasi-lD bands 
of dxz and dyz- In the following, we consider a square 
lattice containing 41 x 41 sites and solve the momentum- 
dependent T-matrix numerically. The LDOS at energy 
i?, which is proportional to the conductance (dl/dV) 
measured by the STM, and its Fourier transformation 
(FT-STM) can be calculated as 



^ — i{k~k')-r 



■.k.k' 



p{q,E) = l^e-'>(f,£;), 



(6) 



Note that in all the FT-STM images presented below, 
p{q = 0,E) are removed to reveal the weaker QPljsH. 
and the absolute intensities of p{q, E) are plotted. 

We start with a heuristic example of ideal quasi-lD 
case in which only t\\ is non-zero without hybridization. 
In this case, the Fermi surface of each band is a set of 



two straight lines located at k^ — ±kp {ky = ±kp) for 
dxz {dyz) bands as shown in the Fig. [l](a). Because the 
DOS is uniform along the Fermi surface, all the quasipar- 
ticle scatterings on the Fermi surface are equally impor- 
tant. The quasiparticle scatterings occur either within 
the same 'Fermi lines' giving rise to the stripes on the x 
and y axes in the FT-STM image (Fig. [Hb)), or between 
the different 'Fermi lines' leading to the remaining weaker 
stripes in Fig. [Ijb). These weaker stripes appearing at 
the lines of Qx — ±2kF and Qy = ±.2kp are the quasi- 
lD analogues of Friedel oscillation in exact ID systems. 
Note that all the QPIs have G4 symmetry because we 
assume that the dxz and dyz bands are degenerate and 
no spontaneous nematic order is present. 

With turning on the hybridization, naively it may be 
expected that these stripe features should disappear since 
the Fermi surfaces are 2D-like. However, we will show ex- 
plicitly that due to the momentum-dependent T-matrix 
some quasiparticle scatterings on the Fermi surfaces are 
greatly suppressed even as the DOS of k points are large. 
As a result, the stripe features still survive as long as 
the Fermi surfaces remain connected. This unique fea- 
ture distinguishes the hybridized quasi- ID bands from a 
single 2D band, for example, the dxy band with similar 
Fermi surface topology. 

Below we consider the on-site spin-orbit (SO) coupling 
Hso = A Li ■ Si to hybridize the dx 



and c?j,2-bands 



35j . Projecting it onto the dxz and d^^-subspace. 



we obtain the hybridization function as: fj:^ = iaXjl. 
Consequently, the effective scattering matrix 1/5^^^^ in 
the eigenband basis becomes: 



^k- - ^0 



cos(6'fe-^fc,) -wsin(0^-0j,) 
iasin(%-0^,) cos(0^-%,) 



(7) 



3 




where taTi29^ 



The diagonal terms 



(the intra-band scattering) are modulated by the form 
factor of cos{9^ — 0^,), which is suppressed around 9j: — 
0^:, « 7t/2 is enhanced around 9^ — 9^^, « 0. For the 
aid to eyes, the values of the 6*^ are represented by the 
background gray scales plotted in Figs. [2la),(c) and[3ja), 
showing white for — > and dark gray for 9-^ 7r/2. 
Since the larger leads to the larger TS^^^ the QPI 

wavevectors connecting two k points from different color 
areas have vanishing weights in the FT-STM images. 

In the hybridized dxz and dyz bands, the DOS van Hove 
(vH) singularity occurs ai X = (tt, 0) and X' = (0,7r). 
Fig. [2] summarizes the results for energies below and 
above the vH singularity. The model parameters are cho- 
sen as: A,Vb) = il.a0.1_^.025, 0.2, 1.0) consis- 
tent with those in Ref. [I^, [Hi] . In Fig. ^h), the 
stripe features remain dominant in the FT-STM images 
at energy below the vH singularity as explained below. 
Although Fermi surface is a 2D closed loop shown in Fig. 
[2] (a), the QPI wavevectors corresponding to scatters- 
ings indicated by the solid arrows are prohibited due to 
the angular form factor discussed above. The dominant 
scatterings still occur in the same way as discussed in 
Fig. [ija), except several q vectors on the stripes have 
stronger features because of the small variations of the 
DOS introduced by tj_ and t' . As energy crosses the vH 
singularity, the topology of the Fermi surface turns into 
discrete segments as shown in Fig. [2jc). The stripe fea- 
tures of the QPI wavevectors disappear and instead they 
become several discrete points whose positions depend on 
the model parameters. As the energy is very close to the 
vH singularity, it has been shown in Ref. [27, 28] that 
the spontaneous nematic order A appears with multi- 
band Hubbard interactions, which gives an anisotropic 
renormalization of dispersion of e' - = e r + A and 

xz,k xz,n 

(! ^ — e , — A. Fig. [3] plots the Fermi surface and the 

yz,k V2,k *= 

FT-STM image for the ground state with A = 0.05. The 
stripe features only extend along one particular direction 
and breaks the C4 symmetry down to C2 symmetry, as 
expected for a nematic order. 

Now we connect the above discussion to the bilayer 
Sr3Ru207 system which has the additional Fermi sur- 
faces of the quasi-2D dxy-ha,nd and the bilayer structure. 
The inter-band scatterings between the quasi-2D and ID 
bands are also suppressed due to the similar reason of dif- 
ferent orbital nature presented above. The QPI pattern 
of the intra dxy-hand scattering should follow the similar 
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FIG. 2: Fermi surfaces (dashed lines) of the two quasi- ID 
bands at energies (a) just below the vH singularity {E = 
1.8) and (c) just above the vH singularity {E — 2.0). The 
corresponding FT-STM images are presented in (b) and (d). 
The background gray scale in (a) and (c) represents the values 
of exhibiting from white to dark gray for = ^ . The 

scatterings between two k points in areas with different colors 
(indicated by the solid arrows) are strongly suppressed. The 
stripe pattern disappears and discrete QPI wavevector points 
become dominant when the Fermi surface breaks down to 
discrete segments. The dashed arrows in (a) and (c) refer to 
the scatterings responsible for the strongest features in the 
FT-STM images. 



The change of the FT-STM images as energy across 
the vH singularity can be used to distinguish the orbital 
configuration of the Fermi surface responsible for the ne- 
matic ordering observed in Sr2Ru3 07, which has been 
proposed both in the quasi-2D dxy-hand 22, 2^ 24 1 and 



the quasi-lD bands of dxz and dyz [27|,l28|. Both propos 



als have similiar Fermi surface topology, but the QPIs 
will be very different. The stripe features are direct con- 
sequences of the quasi- ID bands which have comparable 
DOS on the Fermi surfaces. For the 2D dxy-hands, the 
QPIs are dominated by several discrete q vectors connect- 
ing k points with largest DOS as has been demonstrated 
nicely in the high- Tc cuprate Bi2Sr2CaCu208+5[2§|. Ac- 
analysis published before [29|, |3l|. The quasi- ID bands cordingly, we predict that if it is the 2D dxy-hand re- 



of dxz and dyz have large bilayer splittings resulting in 
bonding and anti-bonding versions. Usually the impurity 
only lies in one layer, thus breaks the bilayer symmetry 
and induces both intra and inter-band scatterings among 
bonding and anti-bonding bands. And all of them should 
have the stripe pattern illustrated before. 



xy 

sponsible for the nematic order, the FT-STM will show 
similar QPIs containing several discrete q vectors as the 
magnetic field is tuned through the critical point for the 
nematic order, while a significant change in the topologies 
of QPIs from Fig. ^h)^ Fig. Mh)^ Fig. ^d) wiU be 
seen if the hybridized dxz and dyz bands are responsible. 
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FIG. 3: (a) Fermi surface and (b) FT-STM image of the two 
quasi-lD band model for Sr3Ru207 with nematic order right 
at the van Hove singularity {E — 1.9). 



These results may also apply to the iron pnictide su- 
perconductors with multiple Fermi surface sheets: ai^2 
bands located near the F point composed mostly of d^z 
and c?j,2-orbitals and (3i^2 bands residing near X and X' 
points with large fraction of d^y orbital 3^, 37 1. Given 



that the tunneling rate along the z direction is strongly 
suppressed with the increase of magnitude of in-plane 
momentum [38| . the tunneling matrix elements of 
(3i^2 bands are naturally to be much smaller than those of 
a 1,2 bands. The similar suppression of tunneling matrix 
elements at large in-plane momentum has been demon- 
strated in the graphene systems [39[. As a result, SF 
STM is expected to observe mostly the QPI scatterings 
from the ai^2 bands, and therefore the stripe features 
should be observed with a length roughly the size of the 
0^1,2 pockets in the normal state of the iron pnictides. 
More interestingly, it has been suggested [i^ based on 
a recent neutron scattering measurement performed on 
the undoped CaFe2As2 that a Heisenberg model with 
highly anisotropic in-plane exchange interactions is re- 
quired to fit the spin- wave dispersion, indicating the pos- 
sibility of nematic order 4l|. Besides, the nematic or- 
der in FaOFeAs compound has also been theoretically 
predictedfH, 43|. If such nematic order exists, the 



stripe features along one certain direction resembling Fig. 
[Stb) should be observable in the FT-STM image. 

In conclusion, we have performed the theoretical inves- 
tigation of a new detection method to the orbital degree 
of freedom and the orbital ordering in metallic transi- 
tion metal oxides. For the quasi-lD dxz and dyz bands 
in the t2g-orbital systems, the Fourier transformed STM 
image of the QPIs exhibit the stripe pattern. When the 
orbital hybridization is present, the T-matrix becomes 
momentum-dependent even for a single impurity prob- 
lem and will suppress some QPI wavevectors depending 
on the hybridization angle 0^. The consequences of the 
orbital ordering in Sr3Ru207 and the iron pnictide super- 
conductors have been pointed out as a nematic distortion 
of the stripe pattern of the QPI. 
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